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Abstract 
Among individuals experiencing internalizing psychopathology, high levels of emotion 
reactivity—the degree to which they experience emotions strongly or intensely, over extended 
periods of time, and as elicited by a variety of stimuli—increase risk for self-injurious thoughts 
and behaviors. Researchers developed the Emotion Reactivity Scale (ERS) to assess emotion 
reactivity, with psychometric support for the measure largely restricted to at-risk clinical 
populations. We know little of the psychometric properties of the ERS when administered as a 
screening measure in community assessments. In a study of the psychometric properties of the 
ERS in a non-clinical assessment of adults, we recruited 105 participants (Mage=44.6; 82.9% 
female) as part of a larger study of adolescent social anxiety and family relationships. 
Participants completed the ERS, self-report measures of various psychosocial domains, and an 
impromptu speech task, before and during which they self-reported their arousal. Scores taken 
from the ERS demonstrated strong internal consistency and demonstrated facets of validity: (a) 
positive relations with measures of internalizing psychopathology and parent-adolescent conflict, 
and negative relations with a measure of quality of life (convergent validity); (b) relations with 
self-reported anxiety and safety-seeking behaviors, over-and-above self-reported depressive 
symptoms (incremental validity); and (c) relation with self-reported state arousal during the 
impromptu speech task, over-and-above self-reported arousal at baseline (criterion-related 
validity). These findings support the psychometric properties of the ERS when administered in 
non-clinic assessments of adults. As such, they have important implications for screening 
assessments designed to identify adults who display the potential for self-injurious thoughts and 


behaviors. 
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Psychometric Properties of the Emotion Reactivity Scale in 
Community Screening Assessments 

Emotion reactivity is an important psychological construct in research on self-injurious 
thoughts and behaviors (SITB) and their relation to internalizing psychopathology (e.g., 
depression, anxiety, borderline personality disorder [BPD]) (Compare, Zarbo, Shonin, Van 
Gordon, & Marconi, 2014; Evans et al., 2016; Glenn, Blumenthal, Klonsky, & Hajcak, 2011; 
Klonsky, Victor, & Saffer, 2014; Nock, 2009; Nock, Wedig, Holmberg & Hooley, 2008). SITBs 
include non-suicidal self-injury (NSSI), suicide ideation, and suicide attempts. Nock and 
colleagues (2008) define emotion reactivity as the degree to which an individual experiences 
emotions a) strongly or intensely (emotional arousal/intensity), b) over long periods of time 
(emotion persistence), and c) as elicited by a wide variety of stimuli (emotion sensitivity). 
Relatively high emotion reactivity predisposes individuals to difficulties regulating their emotions, 
and as such, emotion reactivity and similar constructs (e.g., emotional vulnerability or emotional 
cascade model) play a significant role in conceptual models regarding emotions, internalizing 
psychopathology, and SITB (e.g., Arbuthnott, Lewis & Bailey, 2015; Linehan, 1993; Selby, 
Anestis, & Joiner, 2008). 

Before the advent of research on emotion reactivity, researchers encountered difficulty 
when explaining the progression from clinically significant internalizing problems to SITB. One 
issue in particular is that not all individuals who display internalizing psychopathology also display 
SITB (Klonsky et al., 2014; Nock, 2009; Nock et al., 2008, 2013). Recent work suggests that 
emotion reactivity may help explain the pathway through which the presence of internalizing 
psychopathology poses increased risk for SITB (Bresin, Bender, & Joiner, 2010; Glenn et al., 


2011; Jacobson & Gould, 2007; Klonsky et al., 2014; Najmi, Wegner, & Nock, 2007; Nock, 2009; 
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Nock et al., 2008). Specifically, individuals may engage in SITB to manage or cope with 
maladaptive emotions, or otherwise suppress the emotional impact of stressors in their 
environment (Najmi, et al., 2007; Nock, 2009; Nock et al., 2008). In fact, biological vulnerabilities 
to stress, as well as exposure to stressful life events, may predispose an individual to heightened 
emotion reactivity (Nock, 2009; Nock et al., 2008, 2013; Shapero & Steinberg, 2013). In turn, 
greater emotion reactivity promotes a bidirectional cycle or feedback loop between such reactivity 
and internalizing psychopathology, the combination of which increases risk for SITB (Bresin et 
al., 2010; Klonsky et al., 2014; Najmi et al., 2007; Nock, 2009; Shapero & Steinberg, 2013). 
Emotion reactivity acts as a mediator in the relation between internalizing psychopathology and 
SITB (Najmi et al., 2007; Nock et al., 2008). Furthermore, emotion reactivity heightens an 
individual’s arousal to aversive stimuli, making it a reinforcer for SITB as a functional response 
to the resulting stress (Evans et al., 2016; Nock, 2009; Shapero & Steinberg, 2013). Over time, 
this cycle of distressing emotional reactions to internalizing psychopathology increases in 
intensity, frequency, and pervasiveness, thus creating the perception among distressed individuals 
that engaging in SITB is a viable emotion regulation strategy. 

Research on pain perception during SITB supports these ideas. Physical pain dampens the 
impact of emotional pain, and reductions in pain perception are a function of emotion reactivity 
(Franklin, Aaron, Arthur, Shorkey & Prinstein, 2012). Specifically, individuals reporting higher 
emotion reactivity see greater reductions in emotional pain following experiences with physical 
pain, whereas individuals who report lower emotion reactivity see lower reductions in emotional 
pain following experiences with physical pain (Bresin et al., 2010). Consequently, among 
individuals who experience higher emotion reactivity, SITBs are more rewarding as a perceived 


distress relief strategy, relative to those individuals who experience lower emotion reactivity. The 
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effectiveness of emotion-focused therapeutic models (e.g., dialectical behavior therapy [DBT], 
mindfulness-based cognitive therapy [MBCT], emotion-focused therapy [EFT]) in reducing SITB 
also supports the crucial role of emotion reactivity in SITB (Compare et al., 2014; Deckersbach et 
al., 2011; Glenn et al., 2011; Linehan, 1993; Jacobson & Gould, 2007; Miller & Smith, 2008). In 
particular, treatments that focus on teaching emotion management strategies and decreasing 
emotion reactivity tend to be the most successful techniques for reducing SITB. 

Despite the importance of emotion reactivity in research on SITB and psychopathology, 
researchers historically lacked psychometrically sound instruments for assessing the construct. In 
fact, emotion-focused measures used in research on SITB have primarily assessed emotion 
regulation, with comparatively little research assessing emotion reactivity (Compare et al., 2014; 
Davis et al., 2014; Franklin et al., 2012; Linehan 1993; Nock et al., 2008; Selby et al., 2008). To 
address this gap, Nock and colleagues (2008) developed the Emotion Reactivity Scale (ERS), a 
21-item self-report measure designed to assess an individual’s levels of emotion reactivity. The 
ERS assesses three facets of emotion reactivity: sensitivity (8 items; example item: “I tend to get 
emotional very easily”), arousal/intensity (10 items; example item: “When I experience emotions, 
I feel them very strongly/intensely”), and persistence (3 items; example item: “When I am 
angry/upset, it takes me much longer than most people to calm down’). Response options range 
from 0 (Not at all like me) to 4 (Completely like me), with higher scores indicating greater emotion 
reactivity. 

Preliminary evidence supports interpreting scores from the ERS as reliable and valid 
indices of emotion reactivity. Using a mixed clinical/community sample of adolescents and young 
adults, Nock and colleagues (2008) leveraged explanatory factor analysis to identify the structure 


of the ERS, which yielded the three factors described previously. In this study, total scores taken 
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from the ERS (o=0.94) and scores taken from its sensitivity, arousal/intensity, and persistence 
subscales (a’s=.88, .86, and .81, respectively) all exhibited strong internal consistency. Strong 
internal consistency estimates also manifest in diverse community samples of adolescents and 
clinical samples of adults with bipolar disorder and a history of SITB (Bresin et al., 2010; 
Deckersbach et al., 2011; Evans et al., 2016; Franklin et al., 2012; Shapero, Abramson, & Alloy, 
2016). Research also supports the convergent validity of scores taken from the ERS. In clinical 
and community samples of adolescents and young adults, the ERS relates to measures of SITB, 
internalizing psychopathology (e.g., depressive and anxiety symptoms), temperament (e.g., 
behavioral inhibition, negative affect, aggression), stress (e.g., social stress, negative life events), 
physiology (e.g., cortisol recovery following a social stressor task), and coping (Evans et al., 2016; 
Najmi et al., 2007; Nock, 2009; Nock et al., 2008, 2013; Shapero et al., 2016). Scores taken from 
the ERS also display evidence of criterion-related validity, in that they: (a) significantly distinguish 
individuals diagnosed with mood, anxiety, or eating disorders from individuals who do not meet 
criteria for these diagnoses; (b) significantly distinguish individuals with a history of NSSI, 
suicidal ideation, and suicide attempts from those without a history of SITB; and (c) are sensitive 
to treatment response (Deckersbach et al., 2011; Glenn et al., 2011; Nock et al., 2008). 

Overall, the ERS represents a promising tool for assessing emotion reactivity and its use in 
research on factors that mediate and/or reinforce SITB. Considering the promise of the ERS for 
advancing work on emotion reactivity, researchers should extend the literature on its psychometric 
properties to populations that might benefit from its use. In fact, the majority of studies on the 
psychometric properties of the ERS test the measure within samples of adolescents and relatively 
severe psychiatric populations (e.g., Deckersbach et al., 2011; Franklin et al., 2012; Najmi, et al., 


2007; Nock et al., 2008). We have a poor understanding of the psychometric properties of the ERS 
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when administered to individuals in non-clinic, community settings. In particular, adults in the 
community would benefit from a screening tool designed to signal concerns with emotion 
reactivity, for use in prospective studies of SITB and efforts aimed at SITB prevention. Indeed, if 
the ERS displays psychometric properties consistent with prior work on its use in clinical 
populations, then the measure could serve as a useful tool for identifying individuals who have yet 
to display risks for SITB, but nonetheless display the potential for SITB and thus might benefit 
from preventative care. 
Current Study 

The purpose of this study is to extend the literature on evidence-based assessments of 
emotion reactivity. In a sample of adults who varied in their risk for psychopathology (i.e., adults 
recruited for a non-clinic study as well as adults who sought out a clinical evaluation for their 
adolescent), we tested four hypotheses. First, we expected ERS scores to demonstrate relatively 
high internal consistency estimates (i.e., a@’s >.80; Nunnally & Bernstein, 1994). Second, we 
expected ERS scores to exhibit evidence supporting the measure’s convergent validity, and 
significant associations with established measures of depression, anxiety, safety behaviors, parent- 
adolescent conflict, and quality of life in particular. Third, in support of incremental validity, we 
expected ERS scores to explain significant variance in measures of internalizing psychopathology 
and impairment (i.e., social anxiety, safety behaviors, parent-adolescent conflict, and quality of 
life), over-and-above an established measure of depressive symptoms. Fourth, in support of 
criterion-related validity, we expected ERS scores to significantly predict arousal-related reactivity 


to an emotion-provoking social stressor task, namely an impromptu speech task. 
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Method 
Participants 

Participants included 105 adults recruited from Washington D.C., Maryland, and 
Northern Virginia as part of a larger study conducted with families at a mid-Atlantic university. 
The families contacting the lab responded to one of two advertisements. One targeted parents for 
an evaluation to screen for social anxiety concerns displayed by their adolescent child (i.e., 
clinic-referred group), and the other described a family study on interactions between parents and 
adolescents (i.e., community control group). After completing the assessment, parents of the 
clinic-referred adolescents received assessment feedback, and, when appropriate, were offered 
referrals to diagnostic and treatment services for social anxiety. Parents of community control 
adolescents did not receive either feedback or referrals. 

To be eligible, the study required participants to: (a) be fluent in English, (b) understand 
the consent and interview processes, and (c) have an adolescent child aged 14-15 currently living 
in the home who did not have a history of learning or developmental disabilities, and (d) have 
not received cognitive behavioral therapy in the past three months. The total sample included 37 
clinic-referred families and 68 community control families. Participants included 87 adult 
females and 18 adult males with a mean age in years of 44.58 (SD = 7.52 years). Participants 
identified their racial/ethnic backgrounds as Black or African American (57.1%); White, 
Caucasian American, or European (33.3%); Hispanic or Latino/a (Spanish) (6.7%); Asia 
American or Asian (2.9%); American Indian (2.9%); and “Other” (5.7%). The percentages sum 
to larger than 100% because participants had the option to select multiple racial/ethnic 
backgrounds. Additionally, some participants marked “Other” to identify racial backgrounds that 


were not provided on our demographics list (e.g., Caribbean). Participants also reported on 
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weekly household income using a 10-point Likert scale in $100 increments (e.g. $101-200 per 
week). According to their reports, participants reported weekly household incomes of $500 or 
less (28.6%), between $501 and $900 (23.8%), or $901 or more (47.6%). Participants reported 
their marital status as currently married (43.8%), never married (23.8%), divorced or separated 
from a significant other (26.6%), living with a significant other (4.8%), or widowed (1.0%). 
They reported that their highest level of education completed included less than high school 
(3.8%), high school or equivalent (15.3%), some college (19.0%), associate’s or vocational 
degree (11.5%), bachelor’s degree (19.0%), master’s degree (21.0%), or advanced degree 
(10.5%). Our participants’ demographic information closely reflects the ethnic/racial and 
socioeconomic data from the geographic region sampled (U.S. Census Bureau, 2016). 

Our unique sampling approach provides an optimal sample in which to address our aims. 
In using a sample of parents recruited as part of a larger study of adolescent social anxiety and 
family relationships, we sought to create a sample that varied continuously in levels of emotion 
reactivity (i.e., range of relatively low to relatively high emotion reactivity concerns). A large 
body of work supports that parent and adolescent functioning, as well as family functioning (e.g., 
parent-adolescent conflict), correlate highly (Granic & Patterson, 2006). That is, parent 
functioning impacts adolescent functioning and vice versa, and shared genetic and environmental 
factors contribute to associations between parent, adolescent, and family functioning (Burt, 2009; 
Caspi, Taylor, Moffitt, & Plomin, 2000). For this reason, similar to the range in psychosocial 
functioning observed among adolescents (e.g., De Los Reyes et al., 2019; Deros et al., 2018; 
Thomas, Daruwala, Goepel, & De Los Reyes, 2012), we expected our sample to display large 
variability in participant functioning, including levels of emotion reactivity. The use of a diverse 


sample to address the psychometric properties of a measure of emotion reactivity is consistent 
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with previous psychometric research (e.g. Glenn et al., 2019; Keeley et al., 2018; Qasmieh et al., 
2018), while attempting to broaden literature on individual differences in displays of 
psychosocial functioning. In addition, this approach is consistent with research initiatives 
focused on dimensional models of psychopathology (Insel et al., 2010) and recent research 
supporting the enhanced reliability and validity of dimensional approaches, as opposed to 
discrete approaches to measuring psychopathology (Markon, Chmielewski, & Miller, 2011). 
Procedure 

The Institutional Review Board at the large mid-Atlantic university where the team 
conducted this assessment approved all study procedures. The researchers recruited participants 
through a combination of online advertisements (Craigslist and laboratory websites), public 
transportation flyers (community and university busing services), local advertising boards (town 
community centers, barbershops, and restaurants), and offices of local mental health clinicians. 
Prospective participants completed an initial eligibility screening over the phone prior to 
scheduling their assessment in the laboratory. Participants provided informed consent prior to 
participating in study assessments. 

Participants completed counterbalanced sets of self-report measures on computers using 
Qualtrics Survey data collection software. Participants also engaged in an impromptu speech 
task, in which they had to prepare a short speech into a camera for an unseen audience in another 
room. Participants self-reported on their arousal before and during the speech task. Although all 
105 participants in our study completed survey measures, 2 participants declined to give a speech 
and thus tests of criterion-related validity were based on 103 participants. Upon completing the 


assessment, families received $100 in compensation ($50 to the parent/$50 to the adolescent). 


EMOTION REACTIVITY SCALE COMMUNITY ASSESSMENTS 11 


Measures 

We administered an assessment battery of self-report surveys to assess relevant 
psychological domains examined in this study. As previously described, we also collected 
demographic information through this survey format. 

Emotion reactivity. We assessed emotion reactivity using the previously described ERS 
(Nock et al., 2008). 

Depressive symptoms. We assessed depressive symptoms using a modified version of 
the Beck Depression Inventory-II (BDI-II; Beck et al., 1996; Dozois et al., 1998). The BDI-II is 
a 21-item measure with items rated on a 4-point Likert scale ranging from 0 to 3. Total scores 
range from 0 to 63, with higher scores indicating higher levels of depressive symptoms. We 
excluded item 9, which assessed suicidal thoughts and behaviors, and item 21, which asks about 
a loss of interest in sex. These items inquired about uniquely mature and sensitive information, 
and participants previously declined to consent to answering them. Excluding those two 
questions is consistent with prior research (Lipton et al., 2014; Rausch et al., 2017; Thomas et 
al., 2012). To ensure comparability with scoring for the full measure, we pro-rated items 9 and 
21 for participants based on their individual mean score for the 19 remaining items, maintaining 
the original measure’s score range of 0 to 63. 

Social anxiety symptoms. We assessed social anxiety concerns using the Social 
Interaction Anxiety Survey (SIAS; Mattick & Clarke, 1998). The SIAS is a 20-item self-report 
measure that examines anxiety concerns that may arise during any direct social engagement 
(sample item: “I feel tense if I am alone with just one other person.”). Items rate on a 5-point 
Likert scale ranging from 0 (Not at all characteristic or true of me) to 4 (Extremely 


characteristic or true of me). Total scores range from 0 to 80, with higher scores reflecting 
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higher levels of social anxiety. Previous research supports the measure’s strong internal 
consistency and validity (Rodebaugh, Woods, Heimberg, Liebowitz, & Schneier, 2006). 

Safety-seeking behaviors. We measured engagement in safety-seeking behaviors during 
social situations using the Subtle Avoidance Frequency Scale (SAFE; Cuming et al., 2009). The 
SAFE is a 32-item measure with item responses along a 5-point Likert scale ranging from 1 
(Never) to 5 (Always). On the SAFE, participants endorse the frequency with which they engage 
in specified behaviors (sample item: “Wear clothing or makeup to hide blushing”). Previous 
research supports the construct validity of the SAFE among adults (Cuming et al., 2009). 

Parent-adolescent conflict. To assess parent-adolescent conflict, participants completed 
the Issues Checklist (ICT; Prinz, Foster, Kent, & O’Leary, 1979). Participants reported on topics 
on which they disagreed with their adolescent in the past four weeks. We modified our ICT for 
the purpose of time, reducing participant burden and putting particular focus on topics that 
parents and adolescents typically encounter at home (i.e., chores, friends, and homework). This 
approach is consistent with prior research (Adams & Laursen, 2001; De Los Reyes et al., 2012; 
Fuligni, 1998; Ehrlich, Cassidy, & Dykas, 2011; Smetana & Gaines, 1999; Steinberg, 1987; 
Treutler & Epkins, 2003). This modified ICT used 16 of the 44 topics. Items used are available 
through request from the corresponding author. Items were also modified to be answered along a 
5-point Likert scale from 1 (Do not disagree) to 5 (Disagree much). Participants answered the 
survey based on the adolescent with whom they came to the assessment. Total scores range from 
16 to 80. Prior work supports the validity of scores taken from this version of the ICT (De Los 
Reyes et al., 2012; Ehrlich et al., 2011; Rausch et al., 2017). 

Quality of life. We assessed quality of life using the Quality of Life Enjoyment and 


Satisfaction Questionnaire-Short Form (Q-LES-Q-SF; Endicott, Nee, Harrison & Blumenthal, 
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1993), a 16-item self-report inventory that measures an individual’s general quality of life. The 
Q-LES-Q-SF rated items on a 5-Point scale ranging from | (Very poor) to 5 (Very good) based 
on perceived quality of life in the past week. Question items cover 16 life domains, including 
economic status, living/housing situation, and work. Higher scores indicate a higher quality of 
life. The Q-LES-Q-SF has been found to exhibit strong reliability and validity (Ritscner, Kurs, 
Gibel, Ratner, & Endicott, 2005). 

Impromptu Speech Task 

In addition to completing survey measures, participants completed an impromptu speech 
task (Beidel, Rao, Scharfstein, Wong, & Alfano, 2010). A trained laboratory staff member 
explained to the participant that they would begin a five minute speech about any or all of three 
predetermined topics (i.e., “What are the qualities of a good United States President?”, “Should 
all states adopt mandatory no smoking in public places laws?”, “What should be the legal 
drinking age and/or penalties for drunk driving?”). The staff member then informed the 
participant that they had three minutes to prepare notes for the speech before presenting into a 
camera for a small audience in another room. After the three minutes of preparation, the staff 
member collected the participant’s notes and informed them that they could begin speaking for 
five minutes. 

Self-reported arousal. Before and during the speech task, participants completed the 
Self-Assessment Manikin (SAM; Lang, 1980). The SAM is a five-level pictorial scale 
illustrating gradients of arousal. Participants can choose from 1 (depicted by a close-eyed and 
relaxed figure) to 5 (depicted by a wide-eyed and nervous figure). Participants completed a 
baseline SAM at the beginning of the task, and a SAM for how they felt during the speech. After 


each rating, the participant placed their SAM into an envelope to keep the ratings confidential. 
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Participants reported an average SAM score of 1.44 (SD=0.62) at baseline, and 2.85 (SD=1.05) 
during the speech task. This represents a large-magnitude and significant baseline-to-task 
increase in SAM scores, t(102) = 14.14; p < .001; d= 1.63. These task-related changes in 
emotional arousal support our use of the speech task as a paradigm for testing the criterion- 
related validity of scores taken from the ERS. 

Data Analytic Plan 

We followed a five-step plan to execute our planned analyses. First, we conducted 
preliminary analyses to determine if our data met basic assumptions of parametric statistical tests 
(i.e., skewness/kurtosis within +/- 2.0). Second, we tested the internal consistency of scores taken 
from the ERS by computing Cronbach’s o estimates for the ERS total score and the Sensitivity, 
Arousal/Intensity, and Persistence subscales. Third, we tested the convergent validity of the ERS 
total and subscale scores by computing bivariate correlations among the ERS scores and BDI-II, 
SIAS, SAFE, ICT, and Q-LES-Q-SF scores. 

Consistent with prior work (Bresin et al., 2010; Evans et al., 2016; Glenn et al., 2011), for 
the fourth and fifth steps of our data-analytic plan, we used only the ERS total scores. The high 
correlation among ERS subscales supports exclusive use of the total ERS scores (Nock et al., 
2008), and doing so also reduces risk for Type 1 error. Fourth, we tested the incremental validity 
of the ERS using a series of hierarchical linear regressions. In four separate regression analyses, 
we examined whether the ERS total score explained variance in self-reported social anxiety 
symptoms (SIAS), safety behaviors (SAFE), parent-adolescent conflict (ICT), and quality of life 
(Q-LES-Q-SF), over-and-above the explanatory value of self-reported depressive symptoms 
(BDI-II). Across regressions, we entered self-reported mental health and functioning as criterion 


variables. In these models, we entered the BDI-II total score in the first step as an independent 
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variable (1.e., allowing us to statistically account for the variance attributable to self-reported 
depressive symptoms), and the ERS total score in the second step as an independent variable. 

Fifth, we tested the criterion-related validity of the ERS by examining the relation 
between ERS total scores and participants’ state arousal within social interactions. We 
constructed a hierarchical regression model with self-reported arousal during the speech task as 
the criterion variable (i.e., speech task SAM). We entered baseline SAM scores in the first step 
as the independent variable (i.e., to statistically account for participants’ self-perceived resting 
arousal), and the ERS total score in the second step as an independent variable. 

For all tests described in our analytic plan, we inferred statistical significance of findings 
relative to a p value cutoff of <.05. We inferred magnitudes of effect sizes based on Cohen’s 
(1988) effect size conventions for the effect size d (i.e., small = .30, medium = .50, large = .80) 
and r (i.e., small = .10, medium = .30, large = .50). 

Results 
Preliminary Analyses 

In Table 1, we report means, standard deviations, and internal consistency estimates for 
all survey measures. We conducted preliminary analyses on survey and self-reported arousal 
measures for deviations from normality. All measures exhibited appropriate levels of skewness 
and kurtosis except BDI-II reports, which exhibited significant deviations from normality. Thus, 
we applied a square root transformation to BDI-II reports, which reduced skewness and kurtosis 
to acceptable levels. We used the transformed BDI-II reports in all analyses and report the means 


and standard deviations for both raw and transformed scores in Table 1. 
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Internal Consistency 

We computed Cronbach’s a estimates to test the internal consistencies of the ERS total 
and subscale scores (Table 1). Consistent with our hypotheses, we observed excellent internal 
consistency for the ERS total score, and good internal consistency for the Sensitivity, 
Arousal/Intensity, and Persistence subscales. 
Convergent Validity 

To assess the convergent validity of the ERS, we computed bivariate correlations among 
the ERS total and subscale scores and the BDI-II, SIAS, SAFE, ICT, and Q-LES-Q-SF (Table 2). 
Overall and consistent with our hypotheses, the ERS total and subscale scores exhibited 
significant positive correlations with measures of social anxiety, safety behaviors, depression, 
and parent-adolescent conflict, and significant negative correlations with a measure of quality of 
life. However, the ERS Arousal/Intensity subscale did not exhibit significant correlations with 
measures of parent-adolescent conflict and quality of life. 
Incremental Validity: Links to Self-Report Measures of Social Anxiety, Safety Behaviors, 


Parent-Adolescent Conflict, and Quality of Life 


We conducted four hierarchical regression models to test the incremental validity of the 
ERS (Table 3). Consistent with our hypotheses, increased ERS scores significantly related to 
increased SIAS and SAFE scores, over-and-above the variance explained by BDI-II scores. 
These effects were in the small-to-moderate range. However, increased ERS scores did not 
significantly relate to ICT or Q-LES-Q-SF scores, over-and-above the variance explained by 


BDI-II scores. 
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Criterion-Related Validity: Links to Self-Reported State Arousal within Social Interactions 

We conducted a hierarchical regression model to examine the relation between the ERS 
total score and participants’ state arousal during the speech task (Table 4). In the first step of the 
regression model, self-reported arousal at resting baseline explained significant variance in self- 
reported arousal during the speech task. In the second step of the regression model, ERS total 
scores explained significant variance in self-reported arousal during the speech task, over-and- 
above the variance explained by self-reported arousal at resting baseline. This effect was in the 
small-to-moderate range. 

Discussion 

Main Findings 

This study advanced the literature on assessment of emotion reactivity by testing the 
psychometric properties of the ERS among a community sample of adults. We made four 
findings. First, consistent with our hypotheses and prior work with other populations (e.g., Bresin 
et al., 2010; Franklin et al., 2012; Nock et al., 2008; Shapero et al., 2016), we observed strong 
internal consistency estimates for the ERS total and subscale scores. Second, we observed 
support for the convergent validity of scores taken from the ERS. Specifically, scores taken from 
the ERS demonstrated significant positive correlations with survey measures of depressive 
symptoms, social anxiety, safety behaviors, and parent-adolescent conflict, and a significant 
negative correlation with a survey measure of quality of life. With few exceptions, these patterns 
of significant correlations extended to the ERS subscale scores. 

Third, our study provided support for the ERS’ incremental validity. Specifically, 
consistent with study hypotheses, the ERS total scores explained a significant portion of the 


variance in survey measures of anxiety and safety behaviors over-and-above variance explained 
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by scores taken from an established measure of depressive symptoms. Yet, ERS total scores did 
not explain a significant portion of the variance in survey measures of parent-adolescent conflict 
and quality of life over-and-above a survey measure of depression. From an incremental validity 
standpoint, these findings may indicate that scores taken from the ERS provide useful 
information in relation to constructs that are proximally related to reactivity to one’s social 
environment, such as social anxiety and safety behaviors. Inherent in both constructs is a reaction 
to anxiety-provoking social interactions (Cuming et al., 2009; Mattick & Clarke, 1998), and thus 
it logically follows that ERS scores should provide incremental value in predicting scores taken 
from measures of these constructs. In contrast, scores taken from the ERS may hold less 
incremental value in relation to constructs that are more proximal to depression-related 
impairments or life interferences, such as parent-adolescent conflict and quality of life (Endicott 
et al., 1993; Prinz et al., 1979). However, these interpretations are merely speculative and 
warrant further study. 

Fourth, consistent with our hypotheses and in support of the ERS’ criterion-related 
validity, ERS total scores explained a significant portion of the variance in self-reported arousal 
during a speech task over-and-above baseline arousal. This is an important finding, as it 
highlights the potential of the ERS to predict functioning within ecologically valid tasks known 
to elicit aversive emotional reactions. Indeed, that we observed these effects within a sample that 
was at relatively low risk for SITB further supports the ability of the ERS to provide clinically 
valuable information, even in non-clinic assessment or screening contexts. Overall, our findings 
support the use of the ERS when administered in non-clinic assessments of adults. As such, these 
findings have important implications for screening assessments for emotional reactivity among 


adults at low risk of displaying self-injurious thoughts and behaviors. 
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Clinical and Research Implications 

Our study fills an important gap in research on the ERS. As previously mentioned, 
research examining the psychometric properties of the ERS has been largely limited to non-adult 
and clinical samples (Glenn et al., 2011; Najmi et al., 2007; Nock et al., 2008). To our 
knowledge, our study is the first to demonstrate that the ERS’ psychometric properties generalize 
to a non-clinic sample of adults from the community. Similar to previous studies on youth and 
clinical populations (Compare et al., 2014; Evans et al., 2016), we found significant correlations 
between the ERS and measures of internalizing psychopathology. Thus, there is reason to 
suspect that the ERS can play an important role in prospective assessments of emotion reactivity, 
a construct with significant implications for later psychological functioning. Future research 
should use the ERS among longitudinal community samples of adults to investigate whether 
emotion reactivity mediates the relation between internalizing psychopathology and negative 
health outcomes (particularly SITB; Compare et al., 2014; Najmi et al., 2007; Nock et al., 2008). 
Such work could determine whether, consistent with what has been observed in youth and 
clinical populations, emotion reactivity predicts decreases in emotional distress following 
physical pain (Bresin et al., 2010; Franklin et al., 2012). Such behaviors reinforce the use of 
physical pain for coping with stress (Nock, 2009) while simultaneously allowing the self-injurer 
to overcome innate fears of pain and dying (Klonsky et al., 2014). Consequently, this suggests 
that scores taken from the ERS could contribute unique information in assessment batteries of 
internalizing psychopathology. 

Moreover, the ERS also accounted for variance in self-reported arousal during a stressful 
task over-and-above baseline arousal, suggesting an association between emotion reactivity and 
how individuals perform under stress. There is relatively little research on emotion reactivity 


during stress-inducing tasks (Shapero et al., 2016), so our finding can set the foundation for 
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further studies testing emotion reactivity within controlled laboratory paradigms. In particular, 
future research could use the ERS with community samples of adults to explore the potential 
mediating and reinforcing roles of emotion reactivity that have been previously demonstrated in 
clinical and youth populations. 

Limitations 

Our study displayed several limitations that warrant comment. The first limitation 
involves our exclusive use of self-report measures. Across our validity indices and the ERS, we 
collected self-report data on all constructs, thus raising the possibility that at least some of the 
effects we observed might reflect shared method variance. This highlights the need for future 
research to replicate and extend our findings regarding the ERS with studies that use validity 
indices that incorporate multiple modalities, including behavioral tasks and physiological 
measures. 

The second limitation is the difficulty of differentiating between the constructs of 
elevated emotion reactivity and emotion dysregulation. While the two constructs are 
conceptually separable, Davis and colleagues (2014) argue that not enough effort has been put 
towards measuring their separate effects. Their findings suggest that a poor ability to regulate 
emotions after a distressing event is the more worthwhile phenomenon to measure than how an 
individual reacts to begin with. This contention speaks to the pressing need to develop and refine 
reliable and valid tools for measuring emotion reactivity rather than the consequences of poor 
emotion regulation. It also poses a challenge for causative research, since there are ethical 
concerns in deliberately altering an individual’s emotional responses. To account for the 
previous findings, however, our study would have benefitted from using an emotion regulation 


measure for comparison. 
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Another limitation involves the lack of defined clinical cutoffs within our study. Neither 
prior research nor our current assessment of the ERS’ psychometric properties identified cut 
scores that reflect a clinical level of emotion reactivity and which scores can be considered 
normative or subclinical. Identifying those clinical cutoffs can improve the usability of the 
measure, particularly as it involves identifying more severe psychopathology. Future research on 
the psychometric properties of the ERS might benefit from using receiver operating 
characteristics (for a review, see Youngstrom, 2013) to detect cutoff points in individual 
responses. This can help improve the ERS’ ability to distinguish respondents on relevant clinical 
indices (e.g., symptoms of psychopathology, initiation of self-harming behaviors). 

Lastly, our administration of the BDI-II involved removing items that asked about 
suicidal thoughts and actions and sexual behaviors. We removed these questions due to concerns 
that parents would refuse to participate if they had to answer these questions about their 
adolescents and by extension, themselves. It is possible that our study may have observed 
different results had we not omitted those questions. Despite this adjustment to the scale, we still 
observed high internal consistency with the remaining 19 items. Additionally, we also pro-rated 
these items for the reports we collected from the sample, allowing us to continue measuring the 
BDI-II with the same range as the unadjusted survey. Consequently, we find it unlikely that the 
two removed items would have altered the internal consistency of the BDI-II in any way that 
would significantly alter our findings. 

Concluding Comments 

Our findings suggest that the ERS can reliably and validly assess internalizing 

psychopathology concerns in non-clinical adults from the community. These outcomes are 


consistent with support from previous research on emotion reactivity among adolescent and 
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clinical populations. These findings also support the incremental value of the ERS over-and- 
above measures of constructs commonly linked to SITB (e.g., depressive symptoms) and 
emotions (e.g., social anxiety, safety behaviors). Further, the results of this study demonstrated 
that high emotion reactivity predicts increases in reported arousal during stressful tasks. Our 
findings have important clinical and research implications, as they demonstrate the ERS’ 


viability as a screening tool for future psychological impairments. 
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Table 1 


Means (M), Standard Deviations (SD), and Internal Consistency (a) 


Estimates of Survey Measures (N=105) 


Variable M SD a 

ERS, Total Score 27.73 16.37 0.94 
ERS, Sensitivity Subscale 12.00 7.94 0.88 
ERS, Arousal/Intensity Subscale 10.23 6.25 0.88 
ERS, Persistence Subscale 5.50 3.63 0.81 
BDI-II, Raw 9.21 8.72 0.92 
BDI-II, Square Root 2.64 1.51 - 

SIAS 18.01 13.02 0.93 
SAFE 58.90 15.89 0.91 
ICT 33.50 12.16 0.89 
Q-LES-Q-SF 51.04 8.44 0.87 


Note. ERS = Emotion Reactivity Scale; BDI-IIT = Beck Depression 


Inventory-II; SIAS = Social Interaction Anxiety Scale; SAFE = Subtle 
Avoidance Frequency Examination; ICT = Issues Checklist; Q-LES-Q- 


SF = Quality of Life Enjoyment and Satisfaction Questionnaire Short 


Form. 
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Table 2 


Correlations among Survey Measures (N=105) 


Variable 1 2 3 4 5 6 7 8 9 

1 ERS, Total Score DOr VOLSEe BAe  AOEee cAUtee Aree .24* -.24* 
2 ERS, Sensitivity Subscale BOTS SCTE CAAA ES LGORAS: Eee 25% -.23* 
3 ERS, Arousal/Intensity Subscale ORT ARE Bake ATER .16 -.15 

4 ERS, Persistence Subscale SQEEE  AQREE — BQEEK DR RK BARE 
5 BDI-II DOPEe: “AASER GARE 2h [EOS 
6 SIAS 66*** 12 “20% 
7 SAFE ere) “a 298% 
8 ICT -.30** 
9 Q-LES-Q-SF 


Note. ERS = Emotion Reactivity Scale; BDI-II = Beck Depression Inventory-H; SIAS = Social Interaction Anxiety 
Scale; SAFE = Subtle Avoidance Frequency Examination; ICT = Issues Checklist; Q-LES-Q-SF = Quality of Life 
Enjoyment and Satisfaction Questionnaire Short Form. *p<.05; **p<.01; ***p<.001. 
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Table 3 
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Hierarchical Regressions Examining the Incremental Validity of the ERS (N=105) 


Criterion Variable: Social Anxiety 


Criterion Variable: Parent-Adolescent Conflict 


Dependent Variable: SIAS 


Dependent Variable: ICT 


Variable AR? Total R B(SeB) B Variable AR? Total R B(SeB) B 
Step 1 oeee 39 Step 1 ina 34 
BDI-II 3.37(.78) 39*** |) BDI-II Zable) Pt a 
Step 2 .06** 46 Step 2 01 35 
BDI-II 2.22(.87) .26* BDI-II 2.31(.86) Oe 
ERS .22(.08) Rd is ERS .08(.08) .10 
Criterion Variable: Safety Behaviors Criterion Variable: Quality of Life 
Dependent Variable: SAFE Dependent Variable: Q-LES-Q-SF 
Variable AR? Total R B(SeB) B Variable AR? Total R B(SeB) B 
Step 1 20Pe* 44 Step 1 Aare .67 
BDI-II 4.64(.93) 44*** | BDI-II -3.73(.41) =.67*** 
Step 2 .06** 50 Step 2 01 .67 
BDI-II 3.27(1.03) 1** BDI-II -4.02(.47) or is 
ERS .26(.10) 248% ERS .06(.04) ll 


Note. ERS = Emotion Reactivity Scale; BDI-II = Beck Depression Inventory-I; SIAS = Social Interaction Anxiety Scale; SAFE = 
Subtle Avoidance Frequency Examination, ICT = Issues Checklist; Q-LES-Q-SF = Quality of Life Enjoyment and Satisfaction 


Questionnaire Short Form. *p<.05; **p<.01; ***p<.001. 
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Table 4 


Hierarchical Regression Examining the Incremental Validity of the ERS in Predicting Self-Reported Arousal During the 
Speech Task (N=103) 


Criterion Variable: Self-Reported Arousal During Speech Task 


DV: SAM, During Speech 


Variable AR? Total R b(SEb) B 
Step | 14*** 38 
SAM, Baseline .64(.16) BQH 
Step 2 05* 44 
SAM, Baseline 58(.15) 34K 
ERS .02(.01) 22% 


Note. ERS = Emotion Reactivity Scale; SAM = Self Assessment Manakin; 2 participants declined to give a speech and 
thus analyses were based on 103 participants; *p<.05; **p<.01; ***p<.001. 


